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- r/ie MAILING DATE of this communication appears on the cover shoot with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )I3 Responsive to communication(s) filed on 26 February 1994 , 
2b)\3 This action is FINAL. 2b)l3 This action is non-final. 

3) n Since this application is in condition for allowance except for fonnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) IE Claim(s) 1.6-8.1 3-17.22-24,28,29,31 and 36-48 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) M Claim(s) 1. 6-8. 13-17, 22-24. 28-29, 31 and 36-48 is/are reiected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: aO accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or fomi PTO-152. 

Priority under 35 U.S.C. § 119 

12)0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (0- 
a)n All b)n Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2,n Certified copies of the priority documents have been received in Application No. . 



3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 



Continued Examination Under 37 CFR L114 



1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1 .17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1 . 1 7(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.114. Apphcanfs submission filed on 02/26/2004 has been entered. 



2. The Applicant(s) amended claims 1, 8, 13, 17, 24 and 31, cancelled claims 2-5, 9-12, 18- 
21, 25-27, 30 and 32-35, added new claims 38-48 (see paper 8, pages 2-1 1), and filed the RCE 
examination request (Paper 10) on 04/12/2004. 



3. Applicant's arguments with respect to claims 1-37 (paper 8, page 11-12) have been 
considered but they are not persuasive. 

In response to applicant's argument that "Pickett and Sharman fail to teach or suggest 
every element of this claim (claim 1)" (paper 8, page 1 1, last two Une) and "even considering 
Sharman, its introduction fails to provide the elements of Applicants Claim 1 not shown by 
Pickett" (paper 8, page 12, paragraph 2), examiner disagrees with the appUcant and has a 
different view of prior art teachings and the claim language interpretations. Further, it should be 



Response to Amendment 



Response to Arguments 
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noted that the applicant's arguments lack detailed explanation or reason against the examiner's 
rejection for the specific Umitation of the claim, so that examiner can not respond the arguments 
in specific manner (please see the details in the claim rejection below). 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 1, 6-8, 13-17, 22-24, 28-29, 31 and 36-48 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Pickett (US 2002/0001302 Al), in view of Sharman et al. (US 
6,100,882), hereinafter referenced as Sharman. 

Regarding claim 1, Pickett discloses systems and methods for multiple mode voice and 
data communications using intelligently bridged TDM and packet buses and methods for 
performing telephony and data functions using the same (title), in which VoIP communications 
attempts to provide reasonable voice communications over data/packet networks by allowing 
voice and signaling information to be transported over the data/packet network, and an IP 
network typically is used to transport the calls, which generally may be over an intranet or over 
the Internet (paragraph [0367]) that inherently provides packet based communication session for 
voice and text data, which corresponds to the claimed "communicating voice and text associated 
with a packet based voice communications session". Pickett further discloses that: 
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receiving voice information from a local participant in a packet-based voice 
communications session having at least one remote participant, (paragraph 194 and Figs. 3 and 
13C, 'computer 24 (local and remote participants) is coupled to communications system 50 
(network) over packet bus 80 A', 'a microphone (inherently used for receiving voice 
information)', 'through an appropriate packet standard', 'H.323' 'for transmission to a remote 
computer'; paragraph 370, 'H.323 terminal... used for real-time bi-directional multimedia 
communication'); 

converting the voice information into text, (paragraph 297, 'speech/voice recognition', 
'speech to text conversion, compression, translation'); 

generating a first stream of packets encoding the text (paragraph 297, 'speech to text 
conversion', 'compression (broadly interpreted as encoding)', 'data stream from the LAN, WAN 
..may be desirably coupled to resources' that inherently includes packet based transmission; 
paragraph 298, 'processes the voice data stream into another form (e.g. email, data file, etc.)' that 
includes text form); 

generating a second stream of packets encoding the voice information (paragraph 74, 
'coding/decoding function', 'voice compression', 'voice communication using an Internet 
protocol ("IP") or other voice over other network protocol' that inherently uses packet-based 
transmission); 

communicating the first stream of packets to the remote participant using transmission 
control protocol (TCP) (paragraph 194, 'processor/system resources 70 (Fig. 3) processes the 
packetized data stream, which preferably now is in a suitable form/protocol (such as TCP/IP) for 
transmission to a remote computer'; paragraph 297, 'speech to text conversion. . . thus data 
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stream from the LAN, WAN . . . may be desirably coupled to resources', which suggest that text 
type of data stream can be communicated in the LAN that is packet-based network; paragraph 
298, 'another form (including text form) may be stored, send over the WAN or LAN'); 

communicating the second stream of packets to the remote participant using user 
datagram protocol (UDP) (paragraphs 374 and 388, 'addressing in VoIP is provided in a manner 
to determine the destination EP address', 'UDP header containing source and destination 
sockets', 'voice data is traveling over a data network inside TCP or UCP packets'); 

wherein the packet-based voice communications session comprises an Internet protocol 
(IP) telephony communications session, (paragraph 367, 'VoIP communications attempts to 
provide reasonable voice communications over data/packet networks by allowing voice and 
signaling information to be transported over the data/packet network, and an IP network typically 
is used to transport the calls, which generally may be over an intranet or over the Internet). 

In addition, Pickett discloses that the system provides Voice over IP (VoEP) technique 
(paragraph [0361]), uses H.323 standard (paragraph [0368]), and uses H.323 terminals that can 
either be a PC or a standalone device and provides audio communications while optionally 
supporting video or data communications (paragraph [0361]), which further supports to 
implement the functionality as stated above because both VoIP and H.323 are packet-based 
communications and H.323 supports multimedia communications including audio and text. 

Even though Pickett discloses the capability of generating and communicating packeted 
text data stream and voice data steam, as stated above. Picket does not expressly and clearly 
teach that the text data stream is associated with the content of voice data stream during the 
generating and communicating processes. However, this feature is well known in the art as 
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evidenced by Sharman who discloses textual recoding of contributions to audio conference using 
speech recognition (title), comprising a distributed system performing speech recognition to 
convert speech to text at local workstation (column 2, lines 50-65), and transmitting the both 
speech (voice data stream) and the converted text (data stream) to the other workstation(s) 
(abstract). Therefore, it would have been obvious to one of ordinary skill in the art at time the 
invention was made to modify Pickett by specifically providing the converted text (data stream) 
associated with the voice data stream during the generating and communicating processes, as 
taught by Sharman, for the purpose of offering voice and text with natural conversation and 
providing optional feature of automatic translation for multilingual conferences (Sharman: 
column 3, lines 10-20). 

Regarding claim 6 (depending on 1), Pickett in view of Sharman further discloses 
displaying the text using a visual output device, (Pickett: paragraph 194 and Fig. 3, 'computer 
terminal (also H.323 terminal) 24'; paragraph 72, 'processor/system resources 70 also may 
include a display device'; Sharman: Fig. 9, blocks 945 and 955). 

Regarding claim 7 (depending on 1), Pickett in view of Sharman further discloses 
receiving packets encoding remote voice information and remote text from the remote 
participant; outputting the remote voice information using an acoustic output device; and 
displaying the remote text using a visual output device, (Pickett: paragraph 194 and Fig. 3 and 
13C, 'computer 24 (Fig. 13C) includes ... speaker'; paragraph 370, 'multimedia communication 
apphcation(s)'; paragraph 72, 'processor/system resources 70 also may include a display device'; 
Sharman: Fig. 9, blocks 945 and 955). 
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Regarding claim 8, it discloses an interface for a telecommunication device, which 
corresponds to the combined method claims 1 and 7. The rejection is based on the same reason 
described for claims 1 and 7, because the claims 8 recite same or similar limitation(s) as claims 1 
and 7. 

Regarding claim 13, (depending on 1), Pickett in view of Sharman further discloses to: 

receive local voice information from a local participant in the packet-based voice 
communications session, (Pickett: paragraph 194 and Figs. 3 and 13C, 'computer 24 (local and 
remote participants) is coupled to communications system 50 (network) over packet bus 80A', 'a 
microphone (inherently used for receiving local voice information)', 'through an appropriate 
packet standard', 'H.323' 'for transmission to a remote computer'; paragraph 370, 'H.323 
terminal... used for real-time bi-directional multimedia communication'); 

convert the local voice information into local text (Sharman: column 2, lines 50-65, 
'performing local speech recognition', 'speech from that workstation is converted into text'); 

generate packets encoding the local voice information and the local text (Pickett: 
paragraph 297, 'speech to text conversion', 'compression (broadly interpreted as encoding)', 
'data stream from the LAN, WAN ... may be desirably coupled to resources' that inherently 
includes packet based transmission; paragraph 298, 'processes the voice data stream into another 
form (e.g. email, data file, etc.)' that includes text form; Sharman: column 5, lines 49-50, 
'capable of sending text message from one machine to another' that also inherently includes 
encoding and packetizing); and 

communicate the packets encoding the local voice information and the local text to the 
remote participant, (Pickett: paragraph 194, 'processor/system resources 70 (Fig.3) processes the 
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packetized data stream, which preferably now is in a suitable form/protocol (such as TCP/IP) for 
transmission to a remote computer'; paragraph 298, 'another form (including text form) may be 
stored, send over the WAN or LAN'; Sharman: column 3, lines 59-61, 'transmitting the local 
text equivalent of said local speech input to the other workstation(s)(remote participant) in the 
conference'). 

Regarding claim 14, Pickett and Sharman disclose everything claimed, as appUed above 
(see claim 8). Pickett further discloses using H.323 terminals that can be a PC and provides 
audio communications while optionally supporting video or data communications (paragraph 
[0370]), wherein PC inherently includes the embodied software or program, such as windows 
operating system and GUI tools, which is corresponds to the claimed "the interface comprises a 
computer program embodied in a computer readable medium." 

Regarding claim 15, Pickett and Sharman disclose everything claimed, as applied above 
(see claim 8). Pickett in view Sharman further discloses that data streams may be desirably 
coupled to a resource such as DSP 76 in order to have processes such as speech to text 
conversion (Pickett: paragraph [0297]), plus speech synthesis to covert the text into the correct 
language (herein referring speech language) (Sharman: column 3, linesl8-19), which 
corresponds to the claimed "operable to output the voice information using speech synthesis to 
convert the text into an audio output". 

Regarding claim 16, Pickett and Sharman disclose everything claimed, as applied above 
(see claim 8). Pickett in view Sharman further discloses that an automatic translation unit could 
be interposed between the speech recognition and speech synthesis to convert the text into the 
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correct language for each participant (Sharman: column 3, lines 16- 19), which corresponds to the 
claimed "operable to translate the text from a first language to a second language". 

Regarding claims 17 and 22-23, they disclose telephony communication software 
embodied in a computer readable medium for a telecommunication device, which corresponds to 
the method claims 1 and 6-7, respectively. The rejection is based on the same reason described 
for claims 1 and 6-7 respectively, because the claims 17 and 22-23 recite same or similar 
limitation(s) as claims 1 and 6-7 respectively. 

Regarding claim 24, it discloses a telecommunication system, which corresponds to the 
combined method claim 1 . The rejection is based on the same reason described for claim 24 
because the claim recites same or similar limitation(s) as claim 1. 

Regarding claims 28-29 (depending on claim 24), the rejection is based on the same 
reason described for claims 16 and 15 respectively, because claims 28 and 29 recite same or 
similar Umitation(s) as claims 16 and 15, respectively. 

Regarding claims 31 and 36-37, they disclose an apparatus (device), which corresponds 
to the method claims 1 and 6-7, respectively. The rejection is based on the same reason 
described for claims 1 and 6-7 respectively, because claims 31 and 36-37 recite same or similar 
limitation(s) as claims 1 and 6-7, respectively- 
Regarding claim 38, Pickett discloses systems and methods for multiple mode voice and 
data communications using intelligently bridged TDM and packet buses and methods for 
performing telephony and data functions using the same (title), in which VoIP communications 
attempts to provide reasonable voice communications over data/packet networks by allowing 
voice and signaling information to be transported over the data/packet network, and an IP 
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network typically is used to transport the calls, which generally may be over an intranet or over 
the Internet (paragraph [0367]) that inherently provides packet based communication session for 
voice and text data, which corresponds to the claimed "communicating voice and text associated 
with a packet-based voice communications session". Pickett further discloses that: 
receiving voice information from a local participant in a packet-based voice 
communications session having at least one remote participant (paragraph 194 and Figs. 3 and 
13C, 'computer 24 (local and remote participants) is coupled to communications system 50 
(network) over packet bus 80A', 'a microphone (inherently used for receiving voice 
information)', 'through an appropriate packet standard', 'H.323' 'for transmission to a remote 
computer'; paragraph 370, 'H.323 terminal. . . used for real-time bi-directional multimedia 
communication'); 

detecting a degradation in a quality of the packet-based voice communications session 
(paragraph 105, 'line quality assessment'; paragraph 363, 'enhance voice quality', 'dynamically 
adjustable jitter buffer, packet-loss correction, and noise-level matching', which inherently 
includes detecting a degradation as claimed); 

converting the voice information into text, (paragraph 297, 'speech/voice recognition', 
'speech to text conversion', compression, translation'); 

generating a first stream of packets encoding the text, (paragraph 297, 'speech to text 
conversion', 'compression (broadly interpreted as encoding)', 'data stream from the LAN, WAN 
. . . may be desirably coupled to resources' that inherently includes packet based transmission; 
paragraph 298, 'processes the voice data stream into another form (e.g. email, data file, etc.)' that 
includes text form); 
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generating a second stream of packets encoding the voice information, (paragraph 74, 
'coding/decoding function', 'voice compression', 'voice communication using an Internet 
protocol ("EP") or other voice over other network protocol' that inherently using packet based 
transmission); 

communicating the first stream of packets using transmission control protocol (TCP), 
(paragraph 194, 'processor/system resources 70 (Fig. 3) processes the packetized data stream, 
which preferably now is in a suitable form/protocol (such as TCP/IP) for transmission to a 
remote computer'; paragraph 298, 'processes the voice data stream into the another form (e.g., 
email (text), data file, etc.), which may be stored, send over the WAN or LAN'); 

communicating the second stream of packets using user datagram protocol (UDP), 
(paragraphs 374 and 388, 'addressing in VoIP is provided in a manner to determine . . ., the 
destination IP address', 'UDP header containing source and destination sockets', 'voice data is 
traveling over a data network inside TCP or UCP packets'); 

receiving packets encoding remote voice information and remote text from the remote 
participant (paragraph 2, 'receiving voice and data in multiple modes'; paragraphs 118, 'remote 
computers received a message (text); paragraphs 197, 'VoIP (voice over IP) communication' 'IP 
packeting'; paragraphs 141, 'text message' 'accepting the call'); 

outputting the remote voice information using an acoustic output device, (paragraph 194 
and Fig. 3 and 13C, 'computer 24 (Fig. 13C) includes ... speaker'); and 

displaying the remote text using a visual output device, (paragraph 194 and Fig. 3 and 
13C, 'computer 24' that inherently include video or screen; paragraph 370, 'multimedia 
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communication application(s)'; paragraph 72, 'processor/system resources 70 also may include a 
display device'). 

In addition, Pickett discloses that the system provides Voice over IP (VoIP) technique 
(paragraph [0361]), uses H.323 standard (paragraph [0368]), and uses H.323 terminals that can 
either be a PC or a standalone device and provides audio communications while optionally 
supporting video or data communications (paragraph [0361]), which further supports to 
implement the functionality as stated above because both VoIP and H.323 are packet-based 
communications and H.323 supports multimedia communications including audio and text. 

Even though Pickett discloses the capability of generating and communicating packeted 
text data stream and voice data steam, as stated above. Picket does not expressly and clearly 
teach that the text data stream is associated with the content of the voice data stream during the 
generating and communicating processes and fails to specifically disclose determining that the 
packet-based voice communications session provides for a text communications session. 
However, these features are well known in the art as evidenced by Sharman who discloses 
textual recoding of contributions to audio conference using speech recognition (title), comprising 
a distributed system performing speech recognition to convert speech to text at local workstation 
(column 2, lines 50-65), transmitting the both speech (voice data stream) and the converted text 
(data stream) to the other workstation(s) (abstract). Sharman further discloses that the text 
recording process can be turned on and off during the audio conference (column 4, hnes 1-8), 
which suggests that the voice communication session (audio conference) can provide for a text 
communication session (text recording process) as claimed. Therefore, it would have been 
obvious to one of ordinary skill in the art at time the invention was made to modify Pickett by 
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specifically providing the converted text (data stream) associated with the content of the voice 
data stream during the generating and communicating processes and providing a mechanism 
allowing an audio session to turn on/off a text session, as taught by Sharman, for the purpose of 
produce a set of minutes for an audio conference and ensuring optimum speech recognition 
(Sharman: abstract and column 9, lines 27-31). 

Regarding claim 39 (depending on 1), Pickett in view of Sharman further discloses the 
text recording process (text communications session) can be tumed on (provided) and off during 
the audio conference (the voice communications session) (column 4, lines 1-8), which 
corresponds to the claimed "determining that the packet-based voice communications session 
provides for a text communications session before communicating the first stream of packets to 
the remote participant". 

Regarding claim 40 (depending on 1), Pickett in view of Sharman further discloses 
detecting a degradation in a quality of the packet-based voice communications session before 
communicating the first stream of packets to the remote participant, (Pickett: paragraph 105, 
'line quality assessment (interpreted as detecting)'; paragraph 363, 'enhance voice quality', 
'dynamically adjustable jitter buffer, packet-loss correction, and noise-level matching', which 
suggests detecting a degradation during the voice communication; Sharman: column 4, lines 1-8. 
'the text recording process can be tumed on and off during the audio conference' which suggests 
that voice communication session (and its quality detection) is always before the text session). 

Regarding claim 41 (depending on 8), the rejection is based on the same reason described 
for claim 39 because the claim recites same or similar limitation(s) as claim 39. 
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Regarding claim 42 (depending on 8), the rejection is based on the same reason described 
for claim 40 because the claim recites same or similar limitation(s) as claim 40. 

Regarding claim 43 (depending on 17), the rejection is based on the same reason 
described for claim 39 because the claim recites same or similar limitation(s) as claim 39. 

Regarding claim 44 (depending on 17), the rejection is based on the same reason 
described for claim 40 because the claim recites same or similar limitation(s) as claim 40. 

Regarding claim 45 (depending on 24), the rejection is based on the same reason 
described for claim 39 because the claim recites same or similar limitation(s) as claim 39. 

Regarding claim 46 (depending on 24), the rejection is based on the same reason 
described for claim 40 because the claim recites same or similar limitation(s) as claim 40. 

Regarding claim 47 (depending on 31), the rejection is based on the same reason 
described for claim 39 because the claim recites same or similar limitation(s) as claim 39. 

Regarding claim 48 (depending on 31), the rejection is based on the same reason 
described for claim 40 because the claim recites same or similar limitation(s) as claim 40. 



5. Any response to this office action should be mailed to: 

Commissioner of Patents and Trademarks, P.O. Box 1450, Alexandria, VA223 13-1450 
or faxed to: 

(703)-872-9314 
Hand-delivered responses should be brought to: 

Crystal Park II, 2121 Crystal Drive, Arlington. VA. Sixth Floor (Receptionist). 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to I Han whose telephone numbers is (703) 305-563 1. The 
examiner can normally be reached on Monday through Thursday from 9:00 a.m. to 7: p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
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supervisor, Richmond Devil, can be reached on (703) 305-6954. 

Any inquiry of a general nature of relating to the status of this application or proceeding 
should be directed to the Technology Center 2600 Customer Service Office whose telephone 
number is (703) 306-0377. 

QH/qh 

June 10, 2004 




